GEOMETRIC HAMILTON-JACOBI THEORY 



FOR NONHOLONOMIC DYNAMICAL SYSTEMS 

Jose F. Carinena* 

Departamento de Fisica Teorica 
Facultad de Ciencias, Universidad de Zaragoza, 50009 Zaragoza. Spain 

'q\[ Xavier Gracia^ 

' Departament de Matemdtica Aplicada IV, Universitat Politecnica de Catalunya 

■ Campus Nord UPC edifici C3, C. Jordi Girona 1, 08034 Barcelona, Catalonia, Spain 

Giuseppe Marmo^ 

P ' 

Dipartimento di Scienze Fisiche, Universitd Federico 11 di Napoli, and INFN, Sezione di Napoli 
Complesso Univ. di Monte Sant'Angelo, Via Cintia, 80126 Napoli. Italy 

Eduardo Martinez^ 

Departamento de Matemdtica Aplicada and lUMA 
Facultad de Ciencias, Universidad de Zaragoza, 50009 Zaragoza. Spain 

Miguel C. Munoz-Lecanda? Narciso Roman-RoyH 

I Departamento de Matemdtica Aplicada 4 

Edificio C-3, Campus Norte UPC. C/ Jordi Cirona 1. E-08034 Barcelona. Spain 



< 



14 August 2009 

> 

m 

^SJ ' Abstract 

OO ' The geometric formulation of Hamilton-Jacobi theory for systems with nonholonomic con- 

. straints is developed, following the ideas of the authors in previous papers. The relation 

\ between the solutions of the Hamilton-Jacobi problem with the symplectic structure de- 

fined from the Lagrangian function and the constraints is studied. The concept of complete 
solutions and their relationship with constants of motion, arc also studied in detail. Local 
expressions using quasivelocities are provided. As an example, the nonholonomic free particle 



' is considered. 
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1 Introduction 

In classical mechanics, Hamilton-Jacobi theory tries to integrate a Hamiltonian system of dif- 
ferential equations through an appropriate canonical transformation [3l |18] . The equation to be 
satisfied by the generating function of this transformation is a partial differential equation, and 
having enough solutions to it finally leads to the integration of the system. The Hamilton-Jacobi 
equation is also very close, from the classical side, to the Schrodinger equation of quantum me- 
chanics — see for instance (28]. For these reasons, Hamilton-Jacobi theory has been a matter of 
continuous interest. 

From the viewpoint of geometric mechanics, the intrinsic formulation of Hamilton-Jacobi 
equation is also clear [HESlETj. Nevertheless, in a recent paper [8] we presented a new geometric 
framework for the Hamilton-Jacobi theory. The motivation for this work was that the usual 
formulation of the Hamilton-Jacobi equation heavily relies on the symplectic structure of the 
phase space. However, there are interesting integrable systems that have alternative Lagrangian 
(and Hamiltonian) formulations; two different Lagrangians for the same dynamics may lead 
to two different symplectic structures, and therefore one may wonder about the relevance of a 
concrete symplectic structure and its relation with the solutions of the Hamilton-Jacobi problem. 
Following this program, we formulated the Hamilton-Jacobi equation both in the Lagrangian 
and in the Hamiltonian formalisms of time-independent mechanics, and studied the relations 
between the solutions of the Hamilton-Jacobi equation and the symplectic form; we recovered 
the usual Hamilton-Jacobi equation as a special case in our generalised framework. Additional 
details on the relationship between Hamilton-Jacobi equation and the geometric structures of 
mechanics have recently been presented in [9]. 

Within the Lagrangian formulation, dynamics is described by a second-order vector field 
r defined on the tangent bundle TQ of the configuration manifold Q. The first step in our 
formulation is to describe the integral curves of F as the canonical liftings of the integral curves 
of a family of vector fields X\ on Q. From a geometrical viewpoint, this is pretty simple: each 
of these vector fields has to be X^-related to F. The usual formulation of Hamilton-Jacobi 
equation corresponds to the case where the image of X\ is a Lagrangian submanifold of TQ 
with respect to the symplectic form loi,. With some changes, the same formulation can be given 
in the Hamiltonian framework; properly speaking, it is in this case that we recover the usual 
Hamilton-Jacobi theory. 

Our work [8j was mainly devoted to regular autonomous Lagrangians. However, we also 
considered the time-dependent case (through the so-called homogeneous formalism) as well as a 
special instance of singular Lagrangians: those not yielding Lagrangian constraints. It was clear 
that more general situations could be given a similar description, and it is the purpose of this 
paper to consider the very important issue of mechanical systems with nonholonomic constraints 
— that is, non-integrable constraints depending on the velocities. 

Nonholonomic mechanical systems have been discussed since long ago. There are many pa- 
pers dealing with geometric aspects of such systems, beginning with [35], and including different 
viewpoints asdIIIllIiniEOlEllESlEO] —see also [H El [H ED [M] . When a nonholonomic sys- 
tem is regular, at the end, there is a well-defined dynamics on the submanifold D C TQ defined 
by the constraints. Therefore, it seems quite straightforward to apply our previous framework 
developed in [8] for the Hamilton-Jacobi theory to the case of nonholonomic mechanical systems, 
and, in fact, this has been done in some recent papers as |17 1 I2 H [32]. where the Hamiltonian case 
and some applications are analyzed in deep, as well as in other instances like classical field theo- 
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ries |22j . Note, however, that the relation with the symplectic structure is not so much clear, and 
this is one of the points we address in the present paper, where this new geometric perspective 
for the Hamilton-Jacobi problem is performed under the Lagrangian formalism. In this sense, 
our approach could be considered as complementary to that developed in [T71 [211 [32] . As in our 
previous work [S], we state the standard classical nonholonomic Hamilton-Jacobi problem as a 
particular case of a more general one. Furthermore, we consider two Lagrangian frameworks for 
this: a plain formulation on the velocity space and also an intrinsic formulation on the constraint 
submanifold (the so-called distributional approach to nonholonomic mechanics). Finally, in the 
same lines of our previous paper, we discuss complete solutions for the Hamilton-Jacobi problem 
and their relationship with constants of motion. 

The paper is organised as follows. In section 2 we give a short account of nonholonomic 
mechanics. The Hamilton-Jacobi problem for Lagrangian nonholonomic systems is presented in 
section 3 in both the general and the restricted (standard) versions. Section 4 is devoted to the 
study of the same problem in an intrinsic formulation. Local coordinate expressions are given 
in section 5 by using quasivelocities. Complete solutions are studied in section 6. Finally, a 
detailed example, the nonholonomic free particle, is presented in section 7. 

2 Nonholonomic Lagrangian systems 

We consider an n-dimensional manifold Q, its tangent bundle tq: TQ — Q, and a constraint 
submanifold, which we assume to be a vector subbundle D C TQ of rank r. We consider the an- 
nihilator 1)° CT*Q and the set 5° C T*{TQ) defined by ^ = { a o Ttq G T*{TQ) | a G 2)° }; 
this is a vector bundle over TQ, whose fibre at a point v G TQ, such that tq{v) = q, is more 
explicitly described as 

2)° = { G T*{TQ) I there exists aq G 2)° such that A„ = o T^tq | . 

Given a Lagrangian function L G C°°{TQ), we consider the nonholonomic system defined 
by the Lagrangian L and the linear constraints given by T), that is, only velocities in D are 
admissible. The Lagrange-d'Alembert principle states that the dynamics of the system is given 
by the integral curves (with initial condition in D) of the vector fields F G X{TQ) tangent to D 
that satisfy the second-order condition and the Lagrange-d'Alembert equation (see for instance 

{ircoL - dEL)\v e Sec{V-) , (1) 

where is the Lagrange 2-form associated with L. This expression means that, on the points 
of D, the 1-form it^jl — dEi takes its values in the codistribution D°. 

From now on we assume that L is a regular Lagrangian, which means either that its fibre 
derivative (Legendre transformation) 9"L: TQ — > T*Q is a local diffeomorphism, that the La- 
grange 2-form ujl is a symplectic form, or that its fibre Hessian 3^L = : TQ — > T*Q T*Q 
is everywhere a nondegenerate bilinear form. Given u,v,w G TgQ, the fibre Hessian of the La- 
grangian can also be expressed as G^{v,w) = ujl{v,w^), where v G TyTQ is any vector which 
projects onto v, and is the vertical lift of w on the point u. 

The nonholonomic system {L,T>) is said to be regular if there is a unique solution to 
Lagrange-d'Alembert equation. Here uniqueness must be understood as follows: two solutions 
are considered equal if they coincide when restricted to T) . 
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There are several equivalent ways to ensure regularity of the constrained system. We define 
the subundle T^D C TV ^ H by 

T^V = {V eTV I Ttq{V) G D } . 

We also consider the restriction G^"^ of the fibre Hessian to the distribution D . Then (see 
for instance |12j): 

Theorem 1 The following properties are equivalent: 

1. The constrained Lagrangian system {L,D) is regular, 

2. KerG^^ = {0}. 

3. TTQ\'j) = T^D e (T^l?)^, 

where (T-^D)^ denotes the orthogonal complement ofT'^T) with respect to the symplectic form ujl. 

In the regular case, the constrained dynamics can be found by projection of the free dynamics 
according to the decomposition given in item 3. It follows that the dynamical vector field is a 
SODE on D, that is, F is tangent to D and Ttq{T{v)) = v for every v (z T). 

3 The Lagrangian Hamilton— Jacobi problem for honholonomic 

systems 

As in our previous paper [S], we decompose the study of the Hamilton-Jacobi problem for a 
nonholonomic Lagrangian system in two pieces: first, we consider a general setting to describe 
the solutions of the nonholonomic dynamics T on 2) in terms of the solutions of a family of 
first-order differential equations; second, we study the interplay of these first-order vector fields 
with the corresponding symplectic structure, and impose additional conditions on them in or- 
der to simplify the problem. All this is performed in the Lagrangian formalism — the case of 
Hamiltonian formalism can be developed in quite a similar way. 

3.1 General Lagrangian nonholonomic Hamilton— Jacobi problem 

Following the same lines as in [Hj, we formulate the Hamilton-Jacobi problem in this way: 

Statement 1 (General Lagrangian nonholonomic Hamilton Jacobi problem) Given 
a regular nonholonomic Lagrangian system {L,D), with dynamics given by a SODE vector field 
F € 3C{T)), the general Lagrangian nonholonomic Hamilton-Jacobi problem consists in finding 
the vector fields X : Q ^ TQ such that, if^: M — > Q is an integral curve of X , then 7: M ^ TQ 
takes values in D C TQ and it is an integral curve ofT; that is, 

X o 7 = 7 =^ F o 7 = X o 7 and 7(t) G D for each t G M . 

Any of such X is said to be a solution to the general Lagrangian nonholonomic Hamilton-Jacobi 
problem. 

Theorem 2 A vector field X G 3C{Q) is a solution to the general Lagrangian nonholonomic 
Hamilton-Jacobi problem if, and only if, X G Sec(I') and T o X = TX o X . 
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Proof Let X G 3i{Q) be a solution to the general nonholonomic Hamilton-Jacobi problem. 
For every q £ Q, let 7 be the integral curve of X starting at q; that is, 7 = X o 7 and 7(0) = q. 
Then 77 = 7 is a solution to the constrained problem; that is, 7/(0) G D and r] = T oij. From the 
first one we have that X(q) = X{'y{0)) = 7(0) = r]{0) € !>. As g is arbitrary, it follows that X 
takes values in D. Moreover, 

(F oX){q) = {roXo 7)(0) = (F o 7?)(0) = 77(0) = ^(0) = |(X o 7)(0) 
= {TX o 7)(0) = {TX o X o 7)(0) = {TX o X){q), 

from which it follows that T o X = TX o X. 

Conversely, let X be a vector field taking values in D such that F o X = TX o X. If 7 is an 
integral curve of X then r/ = X o 7 is an integral curve of F: 

For/ = FoXo7 = TX 0X07 = TX 07= — (X 07) = f]. 

dt 

In addition, as //(O) = X(7(0)) € D, it follows that 77 starts at D, and hence it is a solution to 
the constrained dynamics. ■ 

We can rewrite the above statement as follows: a vector field X is a solution to the general 
nonholonomic Hamilton-Jacobi problem if Im (X) is a submanifold of D and F is tangent to this 
submanifold. Conversely, if N is an 7^-dimensional submanifold of 2), transverse to the fibers 
and invariant under F, then locally there exists X E such that N = X(Q) and it is a local 

solution to the general Hamilton-Jacobi problem. 

Remark 1 As in the unconstrained case (when D = TQ) the above result can be stated in a 
more general framework, and in fact, it can be applied to any vector field on T> which satisfies 
the second-order condition. 

The SODE F being the solution of the Lagrange-d'Alembert equation ([1]), we can take the 
pullback of such equation by X, and then obtain an equation that does not involve F explicitly. 

Theorem 3 A vector field X E 2i{Q) is a solution to the general Lagrangian nonholonomic 
Hamilton-Jacobi problem if, and only if, X E Sec('D) and ix{X*uJL) — d{X*EL) E Sec('D°). 

Proof We will use the following preliminary results: 

1. If A E 2)°, then A = a o Ttq for a E 2)°, and we have that X*A = a. In fact, 

{X*\,v) = {aoTTQ,TX{v)) = {a,TTQ{TX{v))) = {a,v) 
for every v E TQ. We will write symbolically this equation as X*D° = D°. 

2. Given a vector field X E 3C(Q), let Y be the vector field along X defined by 1" = F o X — 
TX o X. Consider the one- form a in Q given by 

a = [X^iiriOL - cIEl)] - [ix{X*ojL) - d{X*EL)] . 
A straighforward calculation (see [8j) leads to 



ag{v) = LOLiXiq)) {Y{q), TX{v)) , q e Q , v G TgQ 
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3. If X is a section of D, then for every q ^ Q there exists v E D such that Y{q) = ^ {X{q),v), 
where denotes the vertical hft in TQ. Indeed, it is clear that Y take values in the vertical 
bundle, so that, for every q & Q there exists v G TqQ such that Y{q) = ^^{X{q),v). We 
have just to prove that t; is in D. On the one hand r|D is tangent to D, so that F o X 
takes values in TV, and on the other hand, TX o X also takes values in TD, therefore 
we get that Y{q) G Tx(^q)1). Taking into account that linear constraints for 2) are given 
by the linear functions a associated with 1-forms a taking values in D°, we have that, for 
every a € Sec(D°), 

= Y{q)a = C''{X{q),v)a = {ag,v), 

and hence v & D. 

Bearing this in mind, the proof of the theorem is as follows: 
[4=] Let X G Sec(©) such that ixiX*ujL) - d{X*EL) G Sec(a^°). As itul - dEi G Sec(D°), 
then X*{iYijOL - dEi) G Sec(D°), and hence 

a = [X*{irUL - dEt)] - [ix{X*UL) - d{X*EL)] G Sec(D°). 

The vector field Y along X is vertical, and at every point is the vertical lift of an element in D : 
for every q E Q, there exists v E T> such that Y{q) = ^^{X{q),v). Then for every u; G D we 
have that 

= a,{w) = {uJL{X{q)){e{X{q),v),T,X{w)) = Gj,^^^{v,w) = G^%){v,w). 

Since this equation holds for every w E D and is regular, we have that v = 0, and hence 
Y = 0, which proves the statement. 

[^] If X G Sec(!D) andToX = TX oX, then Y = 0, and hence a = 0. Therefore 

ix{X*u;L) - d{X*EL) = X*{iru;L - dEL) G Sec(D°). 
This completes the proof. ■ 

3.2 Restricted nonholonomic Lagrangian Hamilton— J acobi problem 

As in the unconstrained case, to solve the generalized Lagrangian nonholonomic Hamilton— 
Jacobi problem can be a difficult task; thus it is convenient to consider a simplified, and hence 
less general, problem. 

We have seen that X G 3i{Q) is a solution to the generalized problem if, and only if, the 

difference ix{X*ujL) — d{X*EL) takes values in D°. So we can look for solutions satisfying that 
both terms ix{X*LL!L) and d{X*EL) are in D°. Furthermore the condition ix{X*UL) G Sec(D°) 
can be ensured by imposing that 

iX*LUL)i'D,'D)=0 , 

or equivalently (X*lol){'V , •) G Sec(D°). We will plainly say that the restriction of X*lol to 2) 
vanishes. 

Another possibility could be to impose that {X*ujl){D,-) = 0; but this is a less general 
condition. An additional justification for our choice will be provided in the next section. 

In this way, we can state the following restricted Lagrangian nonholonomic Hamilton-Jacobi 
problem: 
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Statement 2 (Restricted Lagrangian nonholonomic Hamilton Jacobi problem) Given 
a regular nonholonomic Lagrangian system (L, D), find those solutions X to the generalized La- 
grangian nonholonomic Hamilton- J acohi problem such that the restriction of X*iOL to T) van- 
ishes. 

As a consequence, it follows that if X is a solution to the Lagrangian nonholonomic Hamilton— 
Jacobi problem, then d{X*EL) G Sec (2)°). 

Proposition 1 A vector field X € ^{Q) is a solution to the Lagrangian nonholonomic Hamilton- 
Jacohi problem if, and only if, 



Proof The direct statement is obvious. For the converse, we have that X G Sec('D) and both 



ix{X*uJL) and d{X*EL) take their values in D°, so that ix{X*uJL) - d{X*EL) G Sec(a)°), and 



Remark 2 It is important to point out that every solution to the general (restricted) La- 
grangian Hamilton-Jacobi problem for the unconstrained system which takes values on D is, 
automatically, a solution to the general (restricted) Lagrangian nonholonomic Hamilton-Jacobi 
problem. This may be helpful when looking for solutions as we will see in an example later on. 

A particular important case is that of bracket-generating distributions (also known as com- 
pletely nonholonomic distributions). A distribution D C TQ is bracket-generating if the smallest 
Lie subalgebra Ld C X{Q) containing Sec('D) is the full X{Q). In other words, we can get a 
family of vector fields in the distribution T> such that every vector v S TqQ can be obtained as 
a linear combination of the values at q of such vector fields together with repeated brackets. In 
this case we have the following simplification (see [321): 




Proposition 2 Assume that D C TQ is a bracket-generating distribution. A vector field X G 
3i{Q) is a solution to the Lagrangian nonholonomic Hamilton-Jacobi problem if, and only if, 

L X £ Sec(D), 

2. iX*uJL)h = 0, 

3. X*El = constant. 

Proof We just have to prove that, for a bracket-generating distribution, the condition d{X*EL) G 
Sec(2)°) is equivalent to X*El = constant. The result is true for any function / in Q, our case 
being / = X*El. 

Let / be a smooth function on a manifold Q such that df G Sec(!D°). We first prove that / 
is constant on the orbits of the family S'xi of local vector fields taking values in D. Indeed, given 
a point qo in the orbit, any other point qi of the orbit is of the form qi = ° ' " ' °4'ti^){Qo) for 
some vector fields Xi G '3'd and times ti G M. Therefore we can get such point by concatenation 
of a finite number of curves of the form C : t G [0, T] i-^ 'Pt'ii)^ with q a point in the orbit and 



L X e Sec(D) 



2. (X*u;l)|b = 



3. = 0. 



by Theorem [3] the statement holds. 
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X G Integrating df along a curve C of such type we get on one hand df = f{4>T {Q) )~f{Q) 
and on the other df = Jq {df , X)^x(^^-^ dt = Odt = 0. Therefore f{4>^ (q)) = f{q) and / is 
constant along the orbit. 

Finally, for a bracket-generating distribution, Chow-Rashevsky theorem (see for instance 
[2]) ensures that there is only one orbit, the full manifold Q. Therefore, if df takes its values 
in D°, then / is a constant function on Q. ■ 

In the general case, provided that the distribution associated with the Lie algebra L^i is of 
constant rank, we can restrict our dynamical system to each one of the orbits (which are the 
integral manifolds of the distribution associated with L^i, and hence immersed submanifolds of 
Q), thus obtaining a Lagrangian system with nonholonomic constraints defined by a bracket- 
generating distribution. Hence X*El is constant on every orbit of Lxi- 



4 The Hamilton— Jacobi problem in the intrinsic formalism 

In the above sections we have been using the standard Lagrangian formalism of nonholonomic 
constrained problems. Next we develope the theory using the intrinsic Lagrangian formalism 
(also called the distributional approach). This will allow us to justify the choice made for 
stating the Lagrangian nonholonomic Hamilton-Jacobi problem. The distributional approach 
was initiated by Bocharov and Vinogradov [7] and further developed by Sniatycki and coworkers 
[U [35. Similar equations, within the more general framework of Lie algebroids, appear also 
in [12]. 

4.1 Intrinsic Lagrangian formalism for nonholonomic systems 

In the above standard Lagrangian formalism of nonholonomic constrained problems, the theory 
is developed on the whole TQ by introducing the constraint forces. But it is clear that only the 
values in T) are relevant: while the theory depends on the value of the Lagrangian in an open 
neighbourhood of D, the final dynamics is defined only on the submanifold T>. Therefore it is 
interesting to develop the theory intrinsically in T>. 

Recall that we defined the rank 2r vector subbundle T^D — > D of TD by 

T^D = {V eTV I Ttq{V) 

and that item 3 in Theorem [1] expresses the fact that the nonholonomic Lagrangian system is 
regular if, and only if, T^X> is a symplectic subbundle of T{TQ)\d, that is, T^D n (T^K)-^ = 
{0}. Therefore, the restriction of the symplectic form ui^ to the subbundle is regular, 

and hence the pair is a symplectic vector bundle. 

Similarly, we denote by e^"^ the restriction of dEx, to T'^T>. It follows that there exists a 
unique T G Sec(T^D) such that 

ir^^^ = e^^. (2) 

From the definition of u>^'^ and e^"^ one obtains that the section F here is just the restriction 
to T> of the dynamical vector field F of the last section, and it is a SODE in the sense that 
Ttq(T(v)) = V, for every v £ T>. We will not make any notational distinction between the two 
views of the dynamical vector field. 

The advantage of this formulation of the nonholonomic problem is that we can work entirely 
in the bundle T'^T> following similar arguments to those given for the unconstrained case. There 
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is only one relevant difference: the 2-form ai^^ is not exact. In fact it even does not make sense 
to talk about closed forms because T^T> is not a tangent bundle, neither a Lie algebroid, except 
for integrable constraints. 

4.2 The general Hamilton— Jacobi problem 

In this framework, a solution to the general nonholonomic Lagrangian Hamilton-Jacobi problem 
is a section a € Sec (CD) of the vector bundle t: T) ^ Q such that the natural lift of its integral 
curves are integral curves of T. This statement has sense obviously because our bundles are 
subbundles of a tangent bundle, and hence its sections are vector fields. It is also clear that this 
corresponds exactly to the definition in the above section, with a change of notation X a. 

Given a section a € Sec(D) we can define the map Ta: D — > T-^T) as the restriction 
of the tangent map Ta: TQ TD. It is well-defined since Ttq{T(t{v)) = v £ D, so that 
T(t{v) € T'^D. With this definition, and according to Theorem [21 a section a € Sec(2)) is a 
solution to the general nonholonomic Lagrangian Hamilton-Jacobi problem if, and only if, 

r o fj = Ta o a. (3) 

For the following proposition we need a somehow extended notion of the pullback. In par- 
ticular, for a section 6 of the exterior bundle of (T-^I))*, we are redefining the meaning of a* 6 
as the section of the exterior bundle of CD* given by 

{a*e)q{vi, ...,Vp) = e„^q){Ta{vi), . . .,Ta{vp)), 

for q £ Q and vi, . . . ,Vp E D. 

Proposition 3 A section a € Sec (I)) is a solution to the general nonholonomic Lagrangian 
Hamilton-Jacobi problem if, and only if, 

i„[a uj ) = a e 

Proof From equation ([2]), ipw^"^ = e^'^, we have that a* {iruj^'^) = (T*e^"^. Now, taking into 
account that T o a = Ta o a, for every Vq € T) we obtain 

a*{irco^^){vq) = (iru;^^),(,)(T,aK))=^^%)(r(a(g)),r,aK)) 

= a;^%)(V(a(g)),r,aK)) = {a*u;^%ia{q),Vq) = t„{a*u^^){vq), 

and the result follows. ■ 



4.3 The restricted Hamilton-Jacobi problem 

A solution of the (restricted) Lagrangian nonholonomic Hamilton-Jacobi problem is a solution 
a of the general Lagrangian nonholonomic Hamilton-Jacobi problem which moreover satisfies 
the condition 

a*u'^'^ = 0. 

According to the preceding Proposition, it follows that a must also satisfy a*£^'^ = 0. Notice 
that, for f £ D, we have 

{a*e''^,v) = {a*{dEL\r^^),v) = {dEL,Ta{v)) = {d{a*EL),v) , 

so that a*e^'^ = d{a*EL)\D- 

Summarizing, we have proved the following: 
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Proposition 4 A section a S Sec(D) is a solution to the Lagrangian nonholonomic Hamilton- 
Jacobi problem if, and only if, Ta{D) C T'^D is a Lagrangian subbundle of (T'^'D^uj^'^) and 
d{a*EL) G Sec(D°). 

Note that, when the distribution is bracket-generating, the last condition means that the energy 
is constant, as we have seen in Proposition [2] at the end of the preceding section. 

5 Coordinate expressions and quasivelocities 

In order to find local expressions for the objects we have defined, we can use local coordinates in 
the base Q and a set of linear coordinates (quasivelocities [6l[10]) on the tangent bundle adapted 
to the distribution D. This will greatly simplify many expressions. 

Let (x*) be local coordinates on Q and choose a local basis {cq,} of sections of 2). Complete 
with {e^} to a local basis {ea,eA} of 3i{Q), and denote the associated linear coordinates by 
(y", y"^), that is, = and = e^, where {e", e"^} is the dual basis. So we have coordinates 
(x*, y", y"^) of TQ. In these coordinates the constraints read y"^ = 0, so they are adapted to the 
submanifold D C TQ, and (a;*,y") can be used as coordinates for T). 

In the local coordinate system (a;*) on Q, the elements of the basis € 3i{Q) are given by 

i_d_ 

for some local functions /j^ E C°°{Q). The bracket of the sections Cq, is of the form 

[ea,e/3] = Cl^e^ + C^peA, 

with C^^ € C°°{Q) local functions on Q. The constraints are integrable (holonomic) if, and 
only if, = 0. The vector fields have a similar expression, = p\-^- 

Remark 3 In the classical literature, the functions of the type C^^ are known as Hamel's 
transpositional symbols [IS], which obviously are nothing but the structure coefficients (in the 
Cartan's sense) of the moving frame {cq}, see e.g. |13] . Similar expressions arise in the theory 
of Lie algebroids, where the use of quasivelocities appears naturally [T21 123 

Associated with the above basis and coordinates we can find a local basis of sections of T-^D, 
that is, a family of 2r vector fields tangent to D which moreover project point-wise to vectors 
on D. The coordinate vector fields d/dx^ and d/dy'^ are a basis of vector fields tangent to T). 
The vector fields d/dy°^ are vertical so that they project (through Tr) to the zero section of 
D. However, the vectors djdx^ do not (in general) project to admissible velocities. Taking an 
appropriate linear combination we have that the vector fields p^djdx^ project to ea, so that 
they are sections of T-^D. Moreover, since they are linearly independent, we have got a basis 
of sections of T-^D: 

This basis of sections of T-^D can be completed to a basis of sections of TD by adding the 
vector fields 
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and the brackets of the vector fields of such a basis are given by 

[Xa, X/3] = C^^X^ + C^i^Xa, [Xa, = 0, [Va, Vp] = 0. 

A SODE r G Scc(T-^D) is a vector field tangent to D and such that Tt{T(v)) = v for every 
V D. It follows that it is of the form 

r = y-Xa + r{x\yf)Va, 
for some local functions G C°°(D). The differential equations for its integral curves are 

The above expressions can be specialized to the frequent case when the constraints are given 
by expressing some velocities as linear functions of some other velocities, 

- B^{x)x'^ = 0. 

The local basis {6^,6^} can be taken to be 



_ d . d d 



dx^ " ' dx^ ' 

and therefore the adequate quasivelocities are 

ya = Xa, / = - B^{x)x'^. 

The natural velocities are then given in terms of the quasivelocities by 

Xa = ya, x^ = y^ + B^{x)y'^. 
The local basis {X^, V^} of sections of T'^T) can be given in terms of the natiiral coordinates by 

and we can complete it to a local basis of X(D) with 

d 



Xa 



We can further complete to a local basis of X{TQ) with 

Va = -^. 
dx"^ ' 

The commutators of the elements of this basis of sections of T^D are 

[3t;a,3C^]=i?^j^ + |^^^^), [Xa,V^]=0, [V^,Vf,]=0, 



where R^^ = [ea,ep]x^ = ea{Bj) - ep{B^). 
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Lagrange— D'Alembert equations The constrained Lagrangian system {L,D) is regular if 
the restriction of the fibered Hessian to 2) is a regular bilinear tensor at every point. This 
restricted Hessian G^"^ has a particularly simple expression in the coordinates {x\ y°' , y"^) , 

Gf.?,.)(e«,e,) = ^(x^y^O). 

The local expression of Lagrange-d'Alembert equations can be easily written in these coordi- 
nates without the need of Lagrange multipliers. By contracting the equations iruj^"^ — e^"^ = 
with the elements of the basis {Xq,, Vq,}, and taking into account the constraints y"^ = 0, these 
equations read 

where T = y^Xa + f'^'^a is the SODE vector field we are looking for. 

Taking into account the second-order condition, the differential equations for the solutions 
of the dynamics are 

d / dL\ dL ^ p j 
2/^ = 0. 



dL 



(5) 



General Hamilton— Jacob! problem By evaluating the equations (jlj) on the image of the 
section cr, i.e. at a point of the form y° = ct"(x), and taking into account the general Hamilton- 
Jacobi condition, Eq. ([3]), which can be expressed as a relation between differential operators as 
CT* o £jp = o (T*, we obtain 

which is the local expression of the general Hamilton-Jacobi equation. In order to find the 
solutions of the dynamics these equations must be supplemented with the differential equations 
for the integral curves of a, i.e. x* = p\(7°^- 

With a simplified notation, the equations to be solved are 

±' = p'^a^, 

/dL\ dL p dL _ dL ^ p (7) 

where all the partial derivatives of the Lagrangian must be evaluated at points of the form 
(x*,c7"(x)) before taking further derivatives. We remark the formal similarity of these equa- 
tions ([71) and equations which are obtained formally by the substitution y" = (t"(x) every- 
where. 



Restricted Hamilton— J acobi problem For the expression of the Hamilton-Jacobi equation 
we need the explicit expression of the form u)^"^. This coordinate expression can be easily found 
by using the relation 



{x,Y) = d6L{Y,x) = LY{eL{x)) - iix{eL{Y)) + eL{[x,Y]), x,y G Sec(r^©), 
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applied to the elements of the basis {XqjVq,}. It turns out that 



where all the partial derivatives of the Lagraiigian are taken at points in the constraint subbundle 
D, i.e. in the submanifold = 0. Therefore, the local expression of o;^^ is 

where {X",V"} is the dual basis of {XqjVq}. 

To compute pullbacks we can proceed as follows. If cr : Q ^ D is a section of © then the 
map Tu is determined by 

■ dal^ 

Ta{ea) = Xa + Pa-Q-f^P^ 
and therefore the puUback of the dual basis {X^jV"} is 

(T*X" = e" and C7*V" = pt^e'^. 



From this it is straightforward to calculate the local expression of a*LO 



^dy<^dxi ^ dy'^dy^ dx' ) ^dyPdx^ ^ dy^dy^ dx' ) ^ dy^^'^f^ ^ Sy^^"^ 

The equation 17*0;^'^ = is equivalent to the vanishing of the expression between braces: 

i ( ^'^^ da'^ \ ^ / d^L d^L da^ \ dL dL ^ _ 

\dy'^dxi ^ dy'^dy-r dx' ) \dyPdx^ ^ dy^dy^r dx' ) ^ dy-r <^P^ dy^ ' ^ ' 

Alternatively, one can calculate (T*a;-^^(ea, ep) = —d{cr* 9 Ljiea., ep) from where the vanishing 
of a*oj^'^ = is equivalent to the equations 



e"Ke^. 



dyP""") "^^"ydyf^^^J ydy-y"")""!^ \dy^ J ^a(3 
Finally, the pullback by a of the energy is easily calculated: 

...... .(."^..^i^-.)...(^o.)-.o. 

If the distribution is bracket-generating, then the equation d{a*e^'^) G Sec(l)°) can be 
substituted by 

dL 

a'^{x) — {x\ a^{x)) - L{x\ a^{x)) = constant . 
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6 Complete solutions 

The essential idea in the standard (unconstrained) Hamilton-Jacobi theory consists in finding 
a complete family of solutions to the problem (not only one particular solution). In the present 
context a complete solution can be defined as follows: 

Definition 1 Consider a solution ax to the general (respectively, restricted) Lagrangian non- 
holonomic Hamilton-Jacobi problem depending on r = rank(I)) additional parameters A G A 
(where A C M'' is some open set) and suppose that the map <1>: Q x A ^ D given by $(q,A) = 
o'x{q) is a local diffeomorphism. In this case the family {(T\ ; A € A} is said to he a complete solu- 
tion to the general (respectively, restricted) Lagrangian nonholonomic Hamilton-Jacobi problem. 

In other words, a complete solution is a local diffeomorphism $ : Q x A — > D over the identity 
in Q, such that for every A G A the section ax G Sec(D) given by ax{q) = ^{q,X), is a solution 
to the general (restricted) Hamilton-Jacobi problem. 

The interest of this notion is that all the integral curves of T can be actually described as 
integral curves of appropriate vector fields in the complete solution. For every point v G Im$ 
we take q = tq{v) and we find A G such that $(g, A) = v. The vector field ax is a solution 
to the generalized Hamilton-Jacobi problem, with ax{q) = v. Taking the integral curve 7(t) of 
ax passing through q, we have that j{t) is the solution to the dynamics starting at v. 

In what follows, for simplicity, we will assume that <1>: QxA^Disa global diffeomorphism. 
We then define the map F: T) W hy F = pi 2 where pr2 : Q x A — > A is the projection 

onto the second factor. 

Prom the very definition, it follows that a complete solution provides the manifold D with 
a foliation transverse to the fibers of r: D ^ Q, the leaves being the image of the vector fields 
ax, and that the solution vector field T is tangent to the leaves. We now study this foliation 
with more detail, specially in the case of a complete solution to the restricted problem. 

Proposition 5 The following properties hold. 

1. For every A G A we have F~^{X) = Im(a";^). 

2. The map T^: TQ xTA TV restricts to a map T^: V x TA ^ T^D. Moreover 
is a diffeomorphism (a local diffeomorphism if ^ is a local diffeomorphism). 

3. The section f G Sec(D x TA ^ Q x A) defined by f = (r$)-i o T o $ has the form 
f(g,A) = (aA(g),OA). 

4. The components of the map F are constants of motion. 

5. If ^ is a complete solution to the restricted problem, then the subbundles 

{(f,0) G D X TA} and {(0,2:) G D x TA} are Lagrangian subbundles of the symplectic 
bundle (D x TA, $*(a;-^^)) . 

Proof We will make use of the following fact: 



T^{vq,Ox) = Tax{vq). 



(9) 
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Indeed, if 7(5) is a curve in Q such that 7(0) = Vg, then 



ds ' 



=0 



d 

ds' 



d 



/(^a(7(«))) „ = t:K/)(7(s))) 



ds 



s=0 



for every function / € C°°{Ti), which proves the equahty Q. 
Now let us proceed with the proof of the proposition: 

Lug F-'^{\) ^ F{v) = A ^ <^~\v) = {t{v),X) ^v = <^{t{v),\) ^v = ax{T{v)) 
<^=^> u G Im (a\). 

2. For every {vq, zx) eTQ xTA 

TT{T^{Vg, Zx)) = T{t O Zx) = T^Ti{Vq, Zx) = Vq . 

So, r$(?;g, Zx) belongs to T^D if, and only if, Ug G D. 

3. We have just to prove that T<^{ax{q),^x) = r(<&(g. A)), for every (g. A) G Q x A. Using 
([9]), for Vq = (Tx{q) we have that T(^{ax{q),^x) = Tax{(yx{.(l))-, and taking into account 
that Tax o ca = T o o"Ai we finally get 

'T^{ax{q),Qx) = Tax{ax{q)) = T{ax{q)) = T{<^{q,\)). 

4. F is constant on ImciA, and F is tangent to Iukta, so the result follows. 

5. First, using Q we have 

($*^^^)(,,A) (K, Oa), {wq. Oa)) = u^lfq^x) [THy,. Oa), Tcl>(u;„ Oa)) 

= ^kfq,\) {Tax{vq),Tax{wq)) 

= {aloj'^%{Vq,Wq)=0 

Furthermore, notice that T$(Ver(pr^)) = Ver(r), which can be easily proved. Thus 
{<^*u;'^^)^q^x) ((0„ yA), (0„ ^a)) = ^"^""^feA) (Tcl>(0„ yA), Tcl>(0„ zx)) = 

because Ver(r) is an isotropic (in fact Lagrangian) subbundle of the symplectic bun- 
die {T^^,oj^^). 

This finishes the proof. ■ 

In the case of a complete solution to the restricted problem, only the terms of the form 
^*uj^'^{{v, 0), (0, z)) can possibly be nonzero, and they can be expresed in terms of the Hessian, 

(ra;^^)(,,,)(K,OA),(0„ZA)) = G^^^,)K,z(9,A)), 

where z is defined by (Oq, z{q, A)) = T^{Oq, zx). Indeed, by the definition of we have 

(<I>*a;^^)(,,A) (K, Oa), (0„ zx)) = uj^fq^x) (^^aK), T^K, (0„ zx)) 

= iO^^iq){TcTx{Vq),e{0q,z{q,X))) 

= G^.^M(^,z{q,X)). 
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The nonholonomic bracket For a complete solution the map F is a constant of the motion, 
that is, if we denote by fi, . . . , fr the components of F, then every function is a constant of 
the motion for F. Conversely, a family of functionally independent first integrals /i, • • • , fr € 
C°°(D), satisfying the transversality condition det [{dfa , e^)] ^ (where {ca} is any local basis 
for D), defines a complete integral by means of ^~^{v) = {t{v), (/i(f), • • • , fr{v))). 

We now show that this functions are in involution with respect to the nonholonomic bracket. 
One of the possible constructions of such bracket is as follows. Given a function g G C°^(T)), 
we consider the section dg G Sec((T-^I')*) as the restriction of the differential of g to T^D; 
that is, 6g = d^l-^-Bj) . Since the constrained system is regular, we can define the nonholonomic 
Hamiltonian section r]g € Sec(T-^I') by means ir^gUJ^"^ = 6g. Then we define the nonholonomic 
bracket of two functions f,g ^ C°°(D) by means of {f,g}^^ = u>^'^{r]f,r]g). This bracket is 
skewsymmetric but it does not satisfy the Jacobi identity, except if the constraints are actually 
holonomic. 

Theorem 4 If F = (/i, /a, . . . , /.) then {/,, = o. 

Proof We will show that the sections r]f. are of the form r]f. = T^{Xf,0). Indeed, let 
Z G Sec(D X TA ^ Q x A) be the section such that o Zi = rjf^ o <!>. For every u G 2), let 
q = t{v) and A = F{v), so that A) = v. For every w ^T)q we have 

{^*u,^^),[Z,{v),{w,^)) = u^^{T^{Z,{v)),T^{w,Q)) = u^^{r^f^{v),Tax{w)) 

= Tax{w) ■ fi = w {fio ax) = w ■ (Ai) = 

where we have used that F o a\ = \ (constant), and hence fi o ax = Aj. Therefore Zi takes 
values in the orthogonal with respect to ^*ui^'^ of the subbundle {{v,0) G D x TA}. Since this 
subbundle is Lagrangian, we have that Zi takes values on it, i.e. it is of the form Zi = T^{Wi,0). 
But then 

{/^,/,r" = ^^^(r//„r//J =a;^^(r$(T^,,0),rci>(T^„0)) = ($*a;^^) ((T^„ 0), (W^,, 0)) = 0, 
which finishes the proof. ■ 

7 Example 

7.1 The nonholonomic free particle 

Every one-dimensional distribution is integrable, so that the easiest example of a nonholonomic 
system is obtained in by a 2-dimensional distribution. By an adequate change of coordinates, 
the annihilator of T) is generated by the 1-form dx^ —X2dxi. The following example consists on 
a free particle under the action of such a constraint, and it is known as the nonholonomic free 
particle [HOES]. 

Consider a particle moving in Q = M^, with Lagrangian function 

L = ^{xl + xl + xl). 

We have ivl = dxi A dxi + dx2 A dx2 + dx^ A dx^ and dE^ = xidxi + X2dx2 + x^dx^, so the 
unconstrained dynamics is the well-known free dynamics described by the vector field 
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We introduce the nonholonomic constraint 

4> = xz- X2X1 = 0, 

so that the constraint submanifold is D = {{xi, X2,xs;xi,X2,X3) G TQ \ ±3 = X2X1}. Applying 
D'Alembert's principle for nonholonomic dynamics we get 



r = 



d d d 

OX I 0x2 0x3 X2 + 1 0x1 X2 + 1 0x3 



X2X2X1 d ^ X2X1 d 



d 

dx2 ' 



d 
8x3 



As a basis {ca} of sections of D we can take, 

d d 

ei = ^ 1-2:2^—, 62 

0x1 0x3 

which we can complete with the vector field 

The associated quasivelocities are related to the velocities by 

2/1 = xi ±1 = yi 

2/2 = X2 ±2 = 2/2 

y3 = X3-X2Xi X3 = y3 + X2yi. 

The corresponding basis {Xa,Va} can be expressed in terms of the natural coordinates on the 
tangent bundle as 



(10) 



Xl = h X2^ — 

0x1 0x3 

Vl = -^+X2^ 

OXi 0x3 



X2 



V2 



d . _d_ 

dX2 ^ 0X3 

d 
dxo' 



and it is completed to a basis of sections of TV with the vector field 

0X3 

We have that the symplectic section is given by 

u;^'^ = X2yi A + (1 + xl) X^ A + X^ A V^, 

and the 1-form £^-^ is 



X2yf X^ + {l + xl)yiV^+y2V^ 



From here, the dynamical section F, such that 

F = yiX2 + ^2X2 - -^^^12/2^1, 

and the integral curves of F are the solutions to 
xi=yi, X2 = y2, yi 



X2 



y2 = o. 



(11) 



together with the constraint X3 = .X2.X1. 

Note that in this example D is a bracket-generating distribution. Indeed, ei, 62 and 

[61,62] = 



(xi + 1)3/2 V ^^dxi 

are linearly independent at each point of R^. It follows that there is only one orbit for this 
distribution, the full space R^, and hence any pair of points can be joined by concatenation of 
integral curves of vector fields belonging to the distribution D. 
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7.2 The Hamilton— J acobi problem 

Let us state the Hamilton- J acobi problem for this dynamics. According to the general discussion, 
we wish to find the vector fields X in Q such that: 

1. X takes values in T>, and 

2. X and T are X-related: TX o X = r o X. 
From the first condition we have that X has the form 



f d d \ d 



\dxi~^ ^ ) ~^ ^ dx2 ' ^ 



and the second condition leads to 



^ xi + 1 ^ 



or, more explicitly, 



df df df f X2 dg dg dg 

^9^+X2f^ = -fg 2,1 ' fT;—+9^ + X2f^ = 0. (13) 

OXi 0x2 OXs + 1 uxi 0x2 0x3 

It is easy to find particular solutions of these equations. For instance, / = 1, g = is a 
solution and also / = 0, 5 = 1 is a solution. From them we can find some integral curves of the 
dynamics F. However, to obtain all the integral curves of the dynamical vector field we need to 
look for a complete solution. 

Remark 4 An easier way to find these equations (together with the equations for the integral 
curves of X) is from D'Alembert equations ([TT]) by the substitution yi = f and 2/2 = 9- We get 
the equations 

X2 

xi= f, X2 = g, f = -— — 2/5, and g = 0. 

Equations ()13|) follow from this when expanding the total time derivatives of the functions / 
and g and using the first two equations. 

7.3 A complete solution 

In order to get a complete solution, we look for a diffeomorphism <I>: Q x A — > T>, with 
A = M^, such that ^{q,X) = Xx{q). In our case, taking ()12p into account, this means 
^>(xi, X2, X3; Ai, A2) = ixi,X2,X3] f,g,X2f), where the functions f,g satisfy (fT3]) . 

As we already know, any solution to the free problem with values in T) is also a solution to the 
constrained problem. There are some obvious solutions of the free problem that are constant 
vector fields, one of which, X = (0, constant, 0), takes values in D. Thus, as we look for a 
particular complete solution, we can choose g = Xi (constant) and try to find a corresponding 
value of / satisfying 

^ -^1^ ^ ^2/^ = -jAi 2 

0x1 0x2 OT3 X2 + 1 

If we assume that / depends only on X2, f = f{x2), then the above equation is 

df ^ X2 ^ 

dx2 x\ + l ' 
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whose solution is / = \/ x\ + 1. Hence we have a complete solution that can be expressed as 

XxuX2 = + A2 — - ( ^ + ] = XiXi + A2X2, (14) 

9x2 + 1 \9xi dx^J 

with 

X-—^^(— + x — 

^ 5x2' ^ ^/xl + l\dxi ^"^8x3 

In other words, we have the diffeomorphism given by 

4'(xi,X2,X3; Ai,A2) = ixi,X2,X3; ,Ai, f ^/^^ = | = (xi,X2,X3;i;i,i;2,i;3) • 

Prom here we get 

^~^{xi,X2,X3;Xi,X2,X3)= (^i,X2,X3\Xi^J X^ + 1, X2^ = (xi , X2 , X3; Ai , A2) 

and, therefore, we obtain the following constants of motion 



/l = Xi\Jxl + 1, f2 = X2. 

Let us remark the linear expression of -^Ai,A2 5 which is related to the fact that the conserved 
quantities are linear (in the velocities). 

A straightforward calculation shows that the solution that we have found is a solution to the 
restricted Hamilton-Jacobi problem, that is X^^^^uj^'^ = 0. Alternatively, we can calculate the 
puUback of ujl 

A2 

X*{uJl) = / 2 I 1 ^3/2 ^^^^ ~ X2dxi) A dX2, 

{X2 + ij 

which is in the exterior ideal generated by D°. 

The flow of X\-^^x^ can also be easily computed: when Ai 7^ 0, its integral curves are 

Xi{t) = X? + — ^ (argsinh(x2 + Alt) — argsinh(x2)) , 
Al 

X2{t) = a;2 + Alt, 

xsit) = x° + ^ (^1 + (xO + Ait)2 - ^1 + (x0)2) ; 
when Al = 0, the expression of the flow is 



X2{t) 



^2) 

, ^23^2 



It follows that (the tangent lift of) these curves are the solutions of the nonholonomic problem. 
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Another complete solution We can obtain another complete solution by choosing g = Xi 
(constant), as above, but now we try / = f{x2,xs). Then the second equations of (fT3l) holds, 
and the first one reads 

. df df X2 

Ai^ ^^2/^ = -jAi 2 , 

0X2 OX^ ^2 + 1 

which has a solution / = ^ } -. Hence we obtain another complete solution to the 

x^ + l 

Hamilton-Jacobi problem: 

A1X3-A2 d d A1X3-A2 d \ V 1 \ V 

with 

X - ^3 f— — X - f— —\ (IQ) 

^ X2 + I V^^i dxs J 8x2' ^ X2 + I V^^i dxs J ' 

This solution leads to the following constants of motion: 

fl=X3X2-Xi{xl + l), f2 = X2- 

In this case the solution that we found is not a solution to the restricted problem, that is 
"^Ai \2^^'^ 7^ ^' fact, we have 

, . A1X3 — A2 , , Ai , \ \ ^2 ~ 1 7 7 

X [uJLj = -2X2 . 2 I i\2 + 2 I 1 "^1 "^3 + (A1X3 - A2) , 2 1 i\2 "^2 A dx^. 

[X2 + ij X2 + 1- [X2 + ij 



and hence 

,LB _ X2 
1 + X 
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